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Abstract 

We find an explicit integral formula for the eigenfunctions of a 
fourth order differential operator against the kernel involving two Bessel 
functions. Our formula establishes the relation between isT-types in two 
different realizations of the minimal representation of the indefinite or- 
thogonal group, namely the L^-model and the conformal model. 
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1 Introduction and statement of the results 

Let e = x-§^ be the one-dimensional Euler operator. We consider the fol- 
lowing representation of the Bessel differential operator 

1 ^ /^x d^ -I- 1 d , ^ 
dx^ X dx 

where Qv is the quadratic transform of the Weyl algebra C[x, defined 

by 

d " 



Q^(P) = P(P + - x^ forPeC 



X, 

dx 



Our object of study is the L^-eigenfunctions of the fourth order differential 
operator 

D^,u := ^Qu{0 + ^i)Q,{e) 

= ^ ((0 + /u)(0 + ^ + z.) - x2) {e{e + v)- x^) . 

Throughout this article we assume that the parameters /.t and u satisfy the 
following integrality condition: 

/i > > — 1 are integers of the same parity, not both equal to —1. (1-1) 

We then have the following fact (see jJl Theorem A]): 

Fact. The differential operator D^^^ extends to a self-adjoint operator on 
-L^(]R+, x'^'^'^"'"^ dx) with only discrete spectrum which is given by 

Af":=4j(i + ^ + l), j = 0,1,2,... 

The corresponding Lp'-eigenspaces are one- dimensional. 

For instance, it is easily seen that the normalized i^-Bessel function 
Kil{z) := {^)~^ Kil{z) is an L^-eigenfunction of D^^i^ for the eigenvalue 

Ai;-" = 0. ' 

The purpose of this article is to establish the following integral formula 
for L^-solutions of the differential equation 

D^,,,u = A^'^n. (1.2) 

Theorem A. Assume (jl.ip and let u he an L?' -solution of the differential 
equation (|1.2p . Then there exists a constant Aj''^{u) such that for cos?? -|- 
cos > 0: 

oo ^ ^ 

u{x)Jb {ax). J 'A {hx)x^'+''+^ dx 

/cosi? + cos(^\ ~i£±i ~ii±i N n Q^ 

= Aj{u)[ ^ 1 Cj. Mcosi?)C.^^(cosv9), (1.3) 

where we set a := — — and b := "'""^ . 

cos W+COS ip COS w+cos ip 
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Here Ja(x) = (f ) " Ja{x) denotes the normahzed J-Bessel function and 
C^(x) = r(A)C^(x) is the normahzed Gegenbauer polynomial. 

The differential equation ()1.2p has a regular singularity at x = with 
characteristic exponents 0, —v, — /i and —^ — v. Accordingly, the asymptotic 
behaviour of a non-zero L^-solution u of —7- is of the following 

form (see [H Theorem 4.2 (1)]): 

{x'"" + o{x~'') for > 0, 

log(f)+o(log(f)) forz. = 0, (1.4) 
l + o(l) iovv = -l, 



with some non-zero constant Bj''^{u). The constant Aj''^{u) in Theorem A 
is determined by Bj''^{u) as follows: 

Theorem B. For any solution u of (|1.2p ; 



-^r(^) _ .., j!2^^+-r(^)r(^^^)r(i + . 
^n-) ^ ^ r(, + ^)vrr(, + ^ + i) 



— j-T- for u > ^, 
— 1 for V = Q, 
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for u = —1. 



The proofs of Theorems A and B will be given in Sections [2] and [Sj 
respectively. 

In Section U] we give some applications and discuss special values of 
Theorem A. One particularly interesting situation arises when both ^ and 
f are odd integers. In this case the solutions u of (|1.2p can be expressed as 



, , r x-'^e-^Mf'''(2x) for z^ > 1, 

u{x) = const X I ^-.^.,.(^2x) for z. = -1, 

for some polynomial Mj^'*^ (see [3]). For z^ = ±1 these polynomials reduce 

to the classical Laguerre polynomials M^'^^(2;) = Lj{x). Hence, for z^ = ±1 
the integral formula in Theorem A collapses to integral formulas for the 
Laguerre polynomials. Even these we could not trace in the literature. 

Corollary C. Let > 1 be an odd integer and cosi? -|- cos 99 > 0. Set 

a ■= — and b := ""l^^ . Then we have 

cos W+COS ip COS W+COS (fi 

L'^{2x)Ji± (ax) cos{bx)x''e^'' dx 

.2^' /cosi9 + cos^\ 2 + p^^i ,^ 

{-ly— ( cos J + — — V? (cos 
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and 



oo ^ 

L''{2x)Je (ax) sm{bx)x^'e-'' dx 







(-Ir ^ n sm J + — — ]ipC.^ (cost?). 



Note that there appear 5 parameters in the integral formula in Theorem 
A, namely fi, iD, ip and j. Our scheme (specialization of parameters, 
relation to representation theory) is summarized in the following diagram: 

Special Functions Representation Theory 



Gegenbauer 
polynomials 



Conformal model 



, Theorem A 



A^'^ix) : 
L^-solution to (fO 



j=0 



X-Bessel 
functions 
(Section 14.3 




Laguerre 
polynomials 
(Corollary C) 



Polynomial 


3 X X '^e ^ 






u>3 






Mf"(x) 






(see 


0). 





Notation: No = {0, 1, 2, . . .}, ]R+ = {x G M : x > 0}. 



2 Two models for the minimal representation of 
the indefinite orthogonal group 

In the proof of Theorem A we will use representation theory, namely two 
different models for the minimal representation of the indefinite orthogonal 
group G = 0{p, q) where p > q > 2 and p + q > 6 is even. These two mod- 
els were constructed by T. Kobayashi and B. 0rsted [71 [8] and investigated 
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further by T. Kobayashi and G. Mano [6]. This unitary representation is 
irreducible and attains the minimum Gelfand-Kirillov dimension among all 
irreducible unitary representations of G. In physics the minimal represen- 
tation of 0(4,2) appears as the bound states of the Hydrogen atom, and 
incidentally as the quantum Kepler problem. 

2.1 The conformal model 

We begin with a quick review of the conformal model for the minimal rep- 
resentation of G = 0{p,q) from [7]. 

We equip M := S^~^ x S'^~^ with the standard indefinite Riemannian 
metric of signature {p — l,q — 1) by letting the second factor be negative 
definite. Then G acts on M by conformal transformations. The solution 
space 

SoI{Am) := {/ e C°°(M) : Am/ = o} 

of the Yamabe operator = A^p-i — A^g-i — ^^^^ + infinite- 
dimensional. Further, it is invariant under the 'twisted action' w G and 
hence defines a representation. The minimal representation of G is realized 
on the Hilbert completion 

n ■.= SoI{Am) 

of 5o/(Ajv/) with respect to a certain G-invariant inner product. 

The maximal compact subgroup K = 0{p) x 0{q) of G acts on M as 
isometrics, and the restriction of w to K is given just by rotations. To see 
the E'-types we recall the space of spherical harmonics 

n''{W) := {v9 G C7°°(5""i) : A^n-K/j = -k{k + n- 2)ip] , 

or equivalently, the space of restrictions of harmonic homogeneous polyno- 
mials on M" of degree k to the sphere 5""^. The orthogonal group 0(n) 
acts irreducibly on H^iW^) for any k by rotations in the argument. Then 
clearly 

W{W) ® n^iW) C SoI(Am) if and only \i k = j + 
and we put 

W := W{W) (g, W+'^iR"), j = 0, 1, 2, . . . , 

on which K acts irreducibly. The multiplicity-free sum (B'jLqV^ of irreducible 
representations of K is dense in the Hilbert space Ti. 

Let K' be the isotropy group of K at ((1, 0, . . . , 0), (0, . . . , 0, 1)) G 5^"^ x 
S"?-i. Then K' ^ 0{p-l)xO{q-l). We write for the space of A"-fixed 
vectors. 
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Lemma 2.1. In each K-type (j £ Nq) the subspace DTi^' is one- 
dimensional and spanned by the functions 

: X 5"-! ^ C, {vo,v',v",Vp+g.i) ^ {vo)cf,^,{vp+g.i). 

(2.1) 

Proof. It is well-known that any 0{n — l)-invariant spherical harmonic is 
a scalar multiple of the Gegenbauer polynomial 

— n-2 

3 {xi,x')^C^' (xi), 
which shows the claim. □ 



2.2 The L^-model 

We recall the L^-model (Schrodinger model) of the minimal representation 
of G which is unitarily equivalent to zu (see [SlIS])- Consider the isotropic 
cone 

C = {{x',x") G RP~^ X R"-^ : |x'| = \x"\ / 0} C RP+''~^. 

Then the group G acts unitarily in a non-trivial way on the Hilbert space 
LP'{G, d/x) and defines a minimal representation of G. Here dfi is the 0{p — 
l,q — l)-invariant measure on G which is in bipolar coordinates 

R+ X X S"-^ ^ G, (r,w,?/) ^ {ruj,rr]) 

normalized by dfi = ^r^'^'^^^ dr duj drj. (duj and dr] denote the Euclidean 
measures on S*^"^ and S"'"^, respectively.) The representation of the whole 
group G on L'^{G) does not come from the geometry G, but the action of the 
subgroup K' is given by rotation in the argument. Hence the X'-invariant 
functions only depend on the radial parameter r G ]R_|_ and the space of 
K'-invariants in L'^{G) is identified as L'^{G)^' ^ L'^{R+, ^rP+i-^dr). 

Let be the V^-^ -isotypic component in L^{G). In this model it is more 
difficult to find explicit if-finite vectors. By highlighting i^'-fixed vectors, 
the following result was proved in [H Section 8]: 

Lemma 2.2. In each K-type (j G Noj the subspace n L'^{G)^' is 
one- dimensional and given by the radial functions 

u{2r), (2.2) 

where u is an L'^ -solution of (|1.2p with = p — 3, u = q — 3. 
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2.3 The G-intertwiner 

Let T : L^{C) — > H be the intertwining operator as given in [6l Sec- 
tion 2.2]. It is the composition of the Fourier transform cS'(RP+'^~^) — 
S'{W'~^i~'^) and an operator coming from the conformal transformation from 
the flat indefinite Euchdean space M^"^'*^"^ to M. For radial functions 
/ G ^rP+'^~^dr) = L'^(C)^ this operator can be written by means 

of the Hankel transform (cf. [H Lemma 3.3.1]): 

Tfivo,v',v",Vp+g^i) = i+iEI / 

(VO+Vp+g-l) 2 Jo 

X ( ^'"^'^ ) ( ,P+.-5 (2.3) 

for {vo,v' ,v" ,Vp^q^i) G M with fo + 'Wp+c/-! > 0. Since T intertwines the 
actions of G on both models, it clearly maps X'-invariant functions to K'- 
invariant functions and also preserves X-types, i.e. T{W^) = Hence we 
obtain the following diagram: 

— — ^ 

n n 

T: L2(C)^^^^' 

u u 

Now n L2(C)^' and n U^' are one-dimensional and we have 
formulas (|2.2p and (|2.ip for their generators. Hence the intertwiner 7~ has 
to map the functions ()2.2p to multiples of the functions ()2.ip . Thus, for any 
L^-solution u of p.2p and + Vp+g^i > we obtain 

Jo 2 \Vo + Vp+g^iJ 2 + 



P+9-4 



,9-2 



= const • {Vo + Vp+q-l) 2 C- ^ (vo)C.^p_, (Vp+q-l) (2-4) 

J+ 2 

Substituting x = 2r, ^ = p — 3 and u = q — 3 and putting 

COST? = 7;o, cos = 

sini? = sin 99 = \v"\. 

we get p.3p with a certain constant Aj''^ . This finishes the proof of Theorem 
A. 
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3 A closed formula for the constants 



In this section we find an explicit constant for the integral formula in The- 
orem A, namely we give a proof of Theorem B. Our method uses the gener- 
ating function of L^-eigenfunctions of D 



Remember that we assume the integrality condition (jl.ip . Let 



1 ^ / tx 



where /q,(2:) := and Ka{z) := {^)~°^Ka{z) denote the normalized 

/- and if-Bessel functions. Further, let (A^ ''^(a;))j=o,i,2.... be the family of 
functions on M-|_ which has G'^''^{t,x) as its generating function: 

oo 

G>^^^t,x):=Y,^ri^)t'- (3.2) 
i=o 

Fact ([H Theorem A]). Aj'''^{x) is real analytic on and an L'^ -solution 
of dLlI). 







for 


I' 


>0, 


-1 




for 


V 


= 0, 






for 










V 




2 V 











1. 



We will now compute the constants A^-'^ (u) and Bj''^(u) for u = A^'''. 
Here we recall that Aj''^ and Bj''^ were defined in Theorem A and (jl.4p . 
Prom [H Theorem 4.2] we immediately obtain 

B^^\K^/) = xl -I for 1/ = 0, (3.3) 

^ ^ ^ ' ^■!r(i^)r(^i^) ^ ' V ^ 

For A^''^ we have the following lemma: 
Lemma 3.1. For any j G Nq we have 

Putting ()3.3p and ()3.4p together proves Theorem B. In the remaining 
part of this section, we give a proof of Lemma l3. 11 



Proof of Lemma [3TT1 We put {) = if = in ()1.3p . Using the special 
values 

°^^"r(a + l)' ^'^^ ^ " r(n + l)r(2A)' 

we obtain 

2f^+'^'jW(j 4- lLzE±l) poo 
A'-'^iK") = . ^1. / ^(x)x'^+^+^ dx. 



Together with the next lemma this finishes the proof. □ 
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Lemma 3.2. For every j G No we have K^'^ G V- {M.^ , x^^^'^'^ dx) and 

Proof. The fact that A'^''^ G L^(IR+, x^+'^+^ dx) is derived from the asymp- 
totic behaviom' of A^''^(x) (see (Jl Theorem 4.2]). To calculate the integral 
we use the following integral formula which is valid for K(A + aib/3 + l) > 
and 6 > a > (see e.g. [3l formula 6.576 (5)]): 

Uax)Ki3{bx)x^ dx = 2^-^b>^+'-+^T{a +\) 

^ /A + a + /3 + l X + a-/3 + l , ^ 
2F1 ^ , ^ ; a + 1; ;^ 

where 2Fi{a, /3;^; z) denotes the hypergeometric function. With ()3.ip we 
obtain 

jJI" G^'^t, x)x^+'^+i dx = + ^ + (1 - t)^ X 

2-^*1 I ^ 1 — ^ — ; — z — ;r 



2 



= 2^+^r (^ + ^ + ') (i + t)- 

Then, in view of ()3.2p . the claim follows by comparing coefficients of t-'. □ 
Hence, the proof of Theorem B is completed. 



4 Applications and special values 

We conclude this article with some applications of Theorem A and discuss 
on special values of the integral formula. 

4.1 The L2-norm of Kf"" 

As a first application of Theorem A we can give a closed formula for the 
L^-norms of the orthogonal basis (A^''^(x))jgN(, in L^(]R+, x'^ ^ dx). The 
same result was obtained in [H Theorem B] by different methods. 

Corollary 4.1. The Lp'-norm of the eigenfunction A^'"^ is given by 

,1 ,M,.„2 _ 2/-+-ir(j + ^)r(j + ^) 

11^2,,- llL2(M+,xM+-^+idx) - _^.,^2j + M + i)r(i + M + 1) ■ 
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Proof. Let p = + q = v + 3. We define functions ipj G L'^{C) in bipolar 
coordinates by 



ipj{r,u},r]) := A.f''{2r). 



Then it is immediate that 



Now, the intertwining operator T : L'^{C) — )■ ^ is unitary up to a constant, 
namely (see [6l Remark 2.2.2]): 



Using formula ()2.3p for the intertwiner T and Theorem A one also obtains 
easily that 

r^. = 2-^^-(A-)^, 

with ipj as in (j2.1|) . By [Bl Fact 2.1.1 (4)] the G-invariant norm on Ti is given 
by 



m\n - U ^ j ir"iiL2(M)' 
By using the formula (see [31 7.313 (2)]) 



for u €VK 



' sin^^ 7? M 



7r2i-2^r(n + 2A) 
n!(n + A) 



we get 



'^j\\L'2{M) 



j 



_ p-2 ^ g-2 



vol(5P-2)vol(5«-2^ 



,P-2 



C. 2 (cost?) 



dv 

2 



2 



sin'' ^ d(/3 



J 



!2'^+^(j + ^)2r(j + i^ 



2 ^ W I 2 / 

Finally, putting all the steps together shows the claim. 



□ 
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4.2 The Poisson kernel of the Gegenbauer Polynomials 

As another application of Theorem A we get an integral formula for the 
generating function G^'^{t,x) of L^-eigenfunctions, which is closely related 
to the Poisson kernel of the Gegenbauer polynomials. For this we put 







l-t 2 V 1 - t/ 2 



where a := and b := 't"^ . 

cos W+COS ip COS w+cos (p 

Corollary 4.2. For cos •& + cos ip > and — 1 < t < 1 we have the following 
formula: 

+ V + 2 I COS V + COS ip \ ^ -r , r. 

(1 - t) — ^ j ^, if) 

22(m+v) ~ .r(j + Bn^) ^M±i ^ii+i 
^ r(j + ^ + i) ^ j+— 

For [1 = V = 2\ — \ this yields a formula for the Poisson kernel of the 
Gegenbauer polynomials. Recall that the Poisson kernel P\{t,i),f) of the 
Gegenbauer polynomials is defined by (see [H formula (6.4.5)]) 

Px{t,^,ip) := f;^J^^^C„^(cos^)C„^(cosv.)r. 

n=0 ^ + 

(For explicit formulas for the Poisson kernel of the Gegenbauer polynomials 
see e.g. [H formula (7.5.6)].) Now, Corollary 14.21 yields a new expression for 
Px{t,^,ip) (2A G Z, A > 0): 



IT ( COS 1? + COS ip^ 



28A-4 2 

X [Ot + A) [(1 + t)^'^l2A-l,2A-l(-t, ^) 



where 6t = t^. 

4.3 The bottom layer 

As remarked in the introduction, for j = the iiT-Bessel function u{x) = 
{x) is a solution of the differential equation (|1.2|) . In this case the integral 
formula in Theorem A can be written as 

°° , , / xsin-!? \ ^ ( a; sin 09 \ t+1 , 



cos 1? + COS (f J \ COS •& + COS p 

^ - (cos •& + cos ip) sin 2 -Q sin 2 ,^ (cos y?) . 
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This special case was already proved in [6l Lemma 7.8.1]. Another expression 
for this integral can be found in [2l formula 8.13 (14)]. 
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